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Abstract — Families of generalized spatially-coupled low-density 
parity-check (GSC-LDPC) code ensembles can be formed by 
terminating protograph-based generalized LDPC convolutional 
(GLDPCC) codes. It has previously been shown that ensembles 
of GSC-LDPC codes constructed from a protograph have better 
iterative decoding thresholds than their block code counterparts, 
and that, for large termination lengths, their thresholds coincide 
with the maximum a-posteriori (MAP) decoding threshold of 
the underlying generalized LDPC block code ensemble. Here 
we show that, in addition to their excellent iterative decoding 
thresholds, ensembles of GSC-LDPC codes are asymptotically 
good and have large minimum distance growth rates. 

1. Introduction 

Low-density parity-check convolutional (LDPCC) codes 
fl] have been shown to be capable of achieving capacity- 
approaching performance with iterative message-passing de- 
coding (21. The excellent iterative decoding thresholds O, l?) 
that these codes display has been attributed to the threshold 
saturation effect IS), 161 . In addition to good threshold perfor- 
mance, it can also be shown that the minimum free distance 
typical of most members of these LDPCC code ensembles 
grows linearly with the constraint length as the constraint 
length tends to infinity, i.e., they are asymptotically good ||7|, 
fS). A large free distance growth rate indicates that codes 
randomly drawn from the ensemble should have a low error 
floor under maximum likelihood (ML) decoding. 

Generalized LDPC (GLDPC) block codes were first pro- 
posed by Tanner ||9| and have been shown to possess many 
desirable features, such as large minimum distance |[TOl . 
ifTTI and good iterative decoding performance |[T2| . Follow- 
ing this construction, more complicated constraints than a 
single parity-check (SPC) constraint are permitted. In other 
words, a constraint node with n inputs can represent an 
arbitrary {n, k) linear block code. In [[TS], Lentmaier and 
Fettweis showed that ensembles of generalized terminated 
LDPCC codes, called generalized spatially-coupled LDPC 
codes (GSC-LDPC) codes, constructed from a protograph 
have better iterative decoding thresholds than their block code 
counterparts, and that, for large termination lengths, their 
thresholds coincide with the maximum a-posteriori (MAP) 
decoding threshold of the underlying GLDPC block code 
ensemble. 

In this paper, using weight enumerator evaluation techniques 
presented by Abu-Surra, Divsalar, and Ryan llT4l . we study the 
asymptotic weight spectrum of GSC-LDPC code ensembles. 
We show, using a (2, 7) -regular GLDPC block code with 
(7,4) Hamming code constraints as an example, that the 
corresponding GSC-LDPC code ensembles are asymptotically 



good and have large minimum distance growth rates. As the 
termination length increases, we obtain a family of codes 
with capacity approaching iterative decoding thresholds and 
declining minimum distance growth rates. However, since 
these are convolutional codes, a more appropriate distance 
measure for assessing the ML decoding performance of such 
code ensembles is the free distance growth rate of the associ- 
ated ensemble of periodically time-varying generalized LDPC 
convolutional (GLDPCC) codes. Consequently, in the final 
part of the paper, we show that the terminated GSC-LDPC 
code ensembles can be used to obtain an upper bound on 
the free distance growth rate of ensembles of periodically 
time-varying GLDPCC codes. The free distance growth rate 
can also be bounded below by using ensembles of tail-biting 
GLDPCC codes using a similar technique to one previously 
presented for LDPCC code ensembles with SPC constraints 
ifTSl . lE). By comparing and evaluating these bounds we find 
that, for a sufficiently large period, the bounds coincide, giving 
us exact values for the GLDPCC code ensemble free distance 
growth rates. 

II. Background 
A protograph |[T6l is a small bipartite graph that connects 
a set of Ti-u variable nodes V = {vi, . . . , v„„} to a set of ric 
generalized constraint nodes C = {ci, . . . , c„^} by a set of 
edges E. In a protograph-based GLDPC code, each constraint 
node c,„ can represent an arbitrary block code of length ?7f,„ . 
Figure [T] displays the protograph of a (2, 7)-regular GLDPC 
block code. 




Fig. 1: Protograph of a (2, 7)-regular GLDPC block code. The white circles 
represent generalized constraint nodes and the black circles represent variable 
nodes. The labels on the edges indicate the corresponding columns of the 
parity check matrix of the generalized constraint code. 

A protograph can be represented by means of an ric x Uy 
bi-adjacency matrix B, which is called the base matrix of the 
protograph. The entry in row i and column j of B is equal to 
the number of edges that connect nodes q and vj. The base 
matrix of the protograph in Fig. [Tjis given by 



B 



1111111 
1111111 



(1) 



In order to construct ensembles of protograph-based 
GLDPC codes, a protograph can be interpreted as a template 
for the Tanner graph of a derived code, which can be obtained 
by a copy-and-permute operation |fT6l . The protograph is lifted 
by replicating each node N times and the edges are permuted 
among these replicated nodes in such a way that the structure 
of the original graph is preserved. Allowing the permutations 
to vary over all A^! possible choices results in an ensemble of 
GLDPC block codes. 

A. Convolutional protographs 

An unterminated GLDPCC code can be described by a 
convolutional protograph |@] with base matrix 



Bn 



Bo 






Bo 




Bi 








B„i 



(2) 



where rUg denotes the syndrome former memory of the 
convolutional code and the be x by component base matrices 
Bj, i = 0,1, . . . , nis, represent the edge connections from the 
by variable nodes at time t to the be (generalized) constraint 
nodes at time t + i. An ensemble of (in general) time- 
varying GLDPCC codes can then be formed from B[o,oo] 
using the protograph construction method described above. 
The decoding constraint length of the resulting ensemble is 
given as Vs = {rus + l)Nby. 

Starting from the base matrix B of a block code ensemble, 
one can construct GLDPCC code ensembles with the same 
computation trees. This is achieved by an edge spreading 
procedure (see for details) that divides the edges from each 
variable node in the base matrix B among to^ + 1 component 
base matrices B^, i — 0, 1, . . . ,ms, such that the condition 
Bq + Bi + • ■ • + 'Brris = B is satisfied. For example, we 
could apply the edge spreading technique to the (2, 7)-regular 
block base matrix in ([T]i to obtain the following component 
base matrices 



Bo = 
Bi = 



1 1 1 

1 1 1 

11110 

1 1 1 1 



(3) 
(4) 



From a convolutional protograph with base matrix B[o_oo]; 
we can form a periodically time-varying A^-fold graph cover 
with period T by choosing, for the be x by submatrices 
BqjBi, . . . ,B„i^ in the first T columns of B[o,oo]' ^ set of 
N X N permutation matrices randomly and independently to 
form Nbc x Nby submatrices Ho(t), Hi(t + 1), . . . ,H,„^(f + 
ms), respectively, for t = 0, 1, . . . , T — 1. These submatrices 
are then repeated periodically (indefinitely) to form a convo- 
lutional parity-check matrix H[o,oo] such that Hi(i + T) = 
Hi(<), \/i,t. An ensemble of periodically time-varying GLD- 
PCC codes with period T, rate i? = 1 - NMcbc/Nby = 1 - 
Mcbc/by, and decoding constraint length i^s = N{ms + l)by 
can then be derived by letting the permutation matrices used to 
form Ho(t), Hi(t+1), . . . , H,„^ (t+m,), for t = 0, 1, . . . , T- 
1, vary over the A^! choices of an x permutation matrix. 



III. Termination of GLDPCC codes 
Suppose that we start the convolutional code with parity- 
check matrix defined in ^ at time t ~ and terminate it 
after L time instants. The resulting finite-length base matrix 
is then given by 

Bo 



B 



B. 



Bo 



Br 



(5) 



The matrix B[o,l_i] can be considered as the base matrix of 
a terminated protograph-based GLDPCC code, or generalized 
spatially-coupled LDPC (GSC-LDPC) code. This terminated 
protograph is slightly irregular with lower constraint node 
degrees at the beginning and end. These shortened constraint 
nodes are now associated with shortened constraint codes in 
which the symbols of the missing edges are removed. Note that 
such a code shortening is equivalent to fixing these removed 
symbols and assigning an infinite reliability to them. The 
variable node degrees are not affected by termination. 

The parity-check matrix H of the block code derived from 
B[o.L-i] by lifting with some factor A^ has NbyL columns 
and {L + ms)NbcMc rows, where Air denotes the number of 
parity-checks of the constraint codeQ It follows that the rate 
of the GSC-LDPC code is equal to 

(L + ms)beMc - A 



Rl = 1 



Lby 



(6) 



for some A > that accounts for a slight rate increase due 
to the shortened constraint nodes. If H has full rank, the rate 
increase parameter is given by A = 0. However, shortened 
constraint codes at the ends of the graph can cause a reduced 
rank for H, which slightly increases i?^. In this case, A > 
and depends on both the particular constraint code chosen and 
the degree of shortening. As L oo, the rate Rl converges 
to the rate of the underlying GLDPC block code with base 
matrix B. 

The generalized convolutional base matrix B[o oo] can also 
be terminated using tail-biting ifTTI . ifTSll . resulting in a gen- 
eralized tail-biting LDPC (GTB-LDPC) code. Here, for any 
A > iTis, the last bcmg rows of the terminated parity-check 
matrix B[o_a-i] are removed and added to the first bciris rows 



to form the \bc x Xby tail-biting parity-check matrix b|^'' 
tail-biting termination factor A: 

Bo • • ■ Bi 



with 



Bi Bo 

Bm.. B,r„^_i 

B™. 



B„ 



Bo 



Bn 



Bm,-1 
B „ B J, 



Bo 



(7) 



We assume here that each generalized constraint node in the block 
protograph is of the same type and has Mc parity-checks. This assumption 
can be relaxed in general. 



Fig. 2: Protograph of a (2, 7)-regular GLDPCC code ensemble. The white circles represent generalized constraint nodes and the black circles represent variable 
nodes. 



Note that, if m,, = 1 and A = 1, the tail-biting base matrix 
is simply the original block code base matrix, i.e., b|^' = B. 
Terminating B[o in such a way preserves the design rate of 
the ensemble, i.e., Rx = 1 — XbcMc / XK, = 1 — bcMc/by = R, 
and we see that Bj^'' has exactly the same degree distribution 
as the original block code base matrix B. 

IV. Minimum distance analysis of 

PROTOGRAPH-BASED GSC-LDPC CODE ENSEMBLES 

In lfT4l . Abu-Surra, Divsalar, and Ryan presented a tech- 
nique to calculate the average weight enumerator and asymp- 
totic spectral shape function for protograph-based GLDPC 
code ensembles. The spectral shape function can be used to 
test if an ensemble is asymptotically good, i.e., if the minimum 
distance typical of most members of the ensemble is at least as 
large as Sminn, where Smin is the minimum distance growth 
rate of the ensemble and n is the block length. 

Consider the protograph with generalized constraint nodes 
shown in Fig.[T] If we suppose the constraint nodes to be (7, 4) 
Hamming codes with parity-check matrix 



H 



1 — 



10 1110 
10 110 1 
110 11 



then the resulting ensemble has design rate R = 1/7, is 
asymptotically good, and has growth rate S„iin = 0.186 lfT4l . 

We will construct the base matrix of a GSC-LDPC code 
ensemble using (|2]) and component base matrices Q and (|4]i. 
The resulting protograph is shown in Fig. |2] We use the 
(7, 4) Hamming code with parity-check matrix Hi for the 
generalized constraint nodes. The numbers on the edges of 
the protograph in Fig. |2] indicate which columns of Hi (or 
shortened version of Hi) the nodes are connected to. After 
termination, the resulting ensemble corresponds to a GSC- 
LDPC code ensemble. The design rate of the ensemble is given 
as 

6{L + 1) - 2 



Rl = 1 



7L 



(8) 



Note that A = 2 in this example because the two leftmost 
(shortened) constraint nodes in Fig. |2]correspond to shortened 
codes with rate 1/3, i.e., the number of parity-checks in these 
two constraint nodes is Mc = 2, while all of the other 
constraint nodes have Mq = 3 parity-checks. These ensembles 
were shown to have thresholds numerically indistinguishable 
from capacity as L ^ oo in |fT3l . 

The evaluation of the asymptotic weight enumerators for 
GSC-LDPC codes is complex, since the conjecture regarding 
simplification of the numerical evaluation proposed in lfT4l 



cannot immediately be applied to these ensembles. This con- 
jecture relies on grouping together nodes of the same type 
and optimizing them together However, in the GSC-LDPC 
case, nodes from different time instants must be optimized 
separately, even if they are of the same type. 

Fig. [3] shows the asymptotic spectral shape functions for 
the GSC-LDPC code ensembles with termination factors L ~ 
7, 8, 10, 12, 14, 16, 18, and 20. Also shown are the asymptotic 
spectral shape functions for "random" codes of corresponding 
rate Rl calculated using (see |fT9l ) 



iS)=H{S)-{l-RL)H2), 



(9) 



where H{S) = -(1 - S) ln(l - 5) - Sln{5). We observe that 
the GSC-LDPC code ensembles are asymptotically good and 
have large minimum distance growth rates. This indicates that 
a long code based on this protograph has, with probability near 
one, a large minimum distance. As L increases, the design rate 
increases and the minimum distance growth rate decreases. 
This behavior is the same as was observed in the SPC case 

Eol. 



GSC-LDPC 

L = [20,18,16,14,12,10,8,7] 




Fig. 3: Minimum distance growth rates of GSC-LDPC code ensembles and 
random linear codes of the corresponding rate. 



V. Free distance analysis of protograph-based 

GLDPCC CODE ENSEMBLES 

In Fig. [3] we saw that the minimum distance growth rates 
of GSC-LDPC codes decrease as the termination factor L 
increases. However, since GSC-LDPC codes are terminated 
GLDPCC codes, a more appropriate distance measure for 
assessing the ML decoding performance of such codes is the 
free distance growth rate of the GLDPCC ensemble. In this 



section, we first calculate the minimum distance growth rates 
for GTB-LDPC code ensembles and show that for sufficiently 
large termination factors, the growth rates coincide with those 
calculated for the GSC-LDPC code ensembles in Section |IV] 
We then show that the growth rates of the GTB-LDPC code 
ensembles and GSC-LDPC code ensembles can be used to 
obtain lower and upper bounds on the free distance growth 
rate of the GLDPCC code ensemble, respectively. 

A. Minimum distance analysis of GTB-LDPC code ensembles 

We now consider terminating the protograph in Fig. |2] as 
a GTB-LDPC code with termination factor A. Unlike the 
previous termination technique, this results in a (2, 7)-regular 
protograph with design rate Rx = 1/7 for all A. The minimum 
distance growth rates of the GTB-LDPC code ensembles are 
presented in Fig.|4]alongside those corresponding to the GSC- 
LDPC code ensembles. We observe that the growth rates 
remain constant at 5min = 0.186 (the growth rate of the 
original GLDPC block code ensemble) for A = 1,2,...,8, 
and then begin to decay to zero as A ^ oo. Also, as a result 
of the convolutional structure, we observe that the GTB-LDPC 
and GSC-LDPC growth rates coincide for L,X > 10. This is 
the same behavior that we observed for TB-LDPC and SC- 
LDPC codes with SPC constraints ||8|. 

B. Free distance bounds for GLDPCC code ensembles 

Consider an ensemble of periodically time-varying GLD- 
PCC codes with rate R = 1 — hcMc/by and period T 
constructed from a convolutional protograph with base ma- 
trix B[o_oo] (see Q) as described in Section III-AI Using a 
modification of the proof techniques in fS), ifTSl . it is possible 
to show that the average free distance of this ensemble can 
be bounded below by the average minimum distance of an 
ensemble of GTB-LDPC codes derived from the base matrix 
b|^'' (see (|7]i) with termination factor A = T . Here, we show 
that the average free distance of the GLDPCC ensemble can 
also be bounded above by the average minimum distance of the 
ensemble of GSC-LDPC codes derived from the base matrix 



B 



[ox-i] 



(see (|5])) with termination factor L ^ T. 



Theorem 1: Consider a rate i? = 1 — bcMc/by untermi- 
nated, periodically time-varying GLDPCC code ensemble with 
memory nis, decoding constraint length i^s = N{ms + 1)6„, 
and period T derived from B[o^oo]- Let d|^j^„ be the average 
minimum distance of the GSC-LDPC code ensemble with 
block length n = LNb^ and termination factor L. Then 



the ensemble average free distance dj^ee 
convolutional code ensemble is bounded above by (i^7/ri for 



of the unterminated 

-3W 



termination factor L 



T, i.e., 

-liT) -.(T) 



(10) 



Sketch of proof. There is a one-to-one relationship be- 
tween members of the periodically time-varying GLD- 
PCC code ensemble and members of the corresponding 
GSC-LDPC code ensemble with termination factor L = 
T. For any such pair of codes, every codeword x = 
[ xq xi ■ ■ ■ XLNb^-1 ] in the GSC-LDPC (terminated 
convolutional) code can also be viewed as a codeword 
X[o,oo] = [ xq xi ■ ■■ XLNb,,-i • • • ] in the unter- 



minated code. It follows that the free distance d 



(T) 
free 



of the 



unterminated code cannot be larger than the minimum distance 
^min °f terminated code. The ensemble average result 

_(T) — (T) 

dfree ^ '^min 'hen follows dirccOy. □ 
Since there is no danger of ambiguity, we will henceforth 
drop the overline notation when discussing ensemble average 
distance measures. 

C. Free distance growth rates of GLDPCC code ensembles 

For GLDPCC codes, it is natural to define the free distance 
growth rate with respect to the decoding constraint length Vg, 
i.e., as the ratio of the free distance df^ee to Vg. 

By bounding fiyy^p using ( fTOl ). we obtain an upper bound 
on the free distance growth rate as 



AT) 
''free 



< 



T 

min 



where 5, 



(T) 



Vs (TOs + 1)' 



(11) 



free 

dlnl/n = dlnl/iNTb,) is the minimum 



distance growth rate of GSC-LDPC code ensemble with ter- 
mination factor L = T and base matrix B[o.r_i]. Similarly, 
using a similar argument to that presented in [l8l, we have 



free — 



where 6^^^^ is the minimum distance growth rate of the GTB- 
LDPC code ensemble with tail-biting termination factor X = T 



6^^^ T 

7mn 



1)' 



(12) 



and base matrix B 



(A) 
tb 



(T) 

The free distance growth rate that we bound from 

above using (fTTT i is, by definition, an existence-type lower 
bound on the free distance of most members of the ensemble, 
i.e., with high probability a randomly chosen code from the 
ensemble has minimum free distance at least as large as 
i^s as oo. Note that the free distance growth rate 



free 



may also be calculated with respect to the encoding constraint 
length i^e, which corresponds to the maximum number of 
transmitted symbols that can be affected by a single nonzero 
block of information digits. As a result of normalizing by the 
decoding constraint length, it is possible to have free distance 
growth rates larger than 0.5. For further details, see |[8]. 

D. Numerical results 

As an example, we consider once more the (2, 7)-regular 
GLDPCC code ensemble with memory ms ~ 1 and rate R = 
1/7 depicted in Fig. |2l For this case, we calculate the upper 
bound on the free distance growth rate of the periodically time- 
varymg GLDPCC code ensemble as Sy^i^ < usmg 
( fTTT ) for termination factors L = T > 7. Fig. |4] displays the 
minimum distance growth rates of the GSC-LDPC code 
ensembles defined by B[o_l_i] for L = 7, 8, 10, 12, . . . , 20 
that were calculated using the technique proposed in llT4l and 
the associated upper bounds on the GLDPCC code ensemble 
growth rates Sy/^^, < (5„j,/„r/2 for L = T. Also shown are the 
minimum distance growth rates 5^^^^ of the GTB-LDPC code 
ensembles defined by base matrix bI^-* for A = 1, 2, 4, . . . , 20 
and the associated lower bounds on the GLDPCC code en- 
semble growth rates (5yygg > (5,„/„T/2 for A = T calculated 
using ( fT2] i. 

We observe that the calculated GTB-LDPC code ensemble 
minimum distance growth rates Sl^J„ remain constant for 
A = 1 , . . . , 8 and then start to decrease as the termination 
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Fig. 4: Minimum distance growtli rates of GSC-LDPC code ensembles and 
GTB-LDPC code ensembles and calculated upper and lower bounds on 
the free distance growth rates of the associated periodically time-varying 
GLDPCC code ensembles. 

factor A grows, tending to zero as A tends to infinity. Cor- 
respondingly, as A exceeds 8, the lower bound calculated for 
Sf2e levels off at sf^l^ > 0.805. The calculated GSC-LDPC 
code ensemble minimum distance growth rates i5^j^„ are larger 
for small values of L (where the rate loss is larger) and 
decrease monotonically to zero as i ^ oo. Using (fTTT i to 
obtain an upper bound on (5^^^^ we observe that, for T > 10, 
the upper and lower bounds coincide, indicating that, for these 

(T) 

values of the period T, Sj^j,^ = 0.805, significantly larger than 
the underlying GLDPC block code minimum distance growth 
rate dmin = 0.186. In addition, we note that, at the point where 
the upper and lower bounds on <5j^gg coincide, the minimum 
distance growth rates for both termination methods also coin- 
cide. Recall that the GTB-LDPC code ensembles all have rate 
1/7, wheras the rate of the GSC-LDPC code ensembles is a 
function of the termination factor L given by (O. This general 
technique can be used to bound the free distance growth rate 
above and below for any regular or irregular periodically time- 
varying protograph-based GLDPCC code ensemble. 

While large free distance growth rates are indicative of 
good ML decoding performance, when predicting the iterative 
decoding performance of a code ensemble in the high SNR 
region other graphical objects such as trapping sets, pseu- 
docodewords, absorbing sets, etc., come into effect. Based on 
results from the SPC case JS], we would expect GSC-LDPC 
codes with large minimum/free distance growth rates to also 
have large trapping set growth rates, indicating good iterative 
decoding performance in the high SNR region. 

VI. Conclusions 

GSC-LDPC codes constructed from a protograph are known 
to have better iterative decoding thresholds than their block 
code counterparts, and, for large termination lengths, their 
thresholds coincide with the MAP decoding threshold of the 
underlying GLDPC block code ensemble. In this paper, we 
used an asymptotic weight enumerator analysis to show that 
GSC-LDPC code ensembles are also asymptotically good. 
We saw, using a (2, 7)-regular GLDPC code as an example, 
that the corresponding GSC-LDPC code ensembles have large 
minimum distance growth rates for all computed values of L. 



This indicates that long codes chosen from these ensembles 
have, with probability near one, large minimum distances 
as well as excellent iterative decoding thresholds. Finally, 
we obtained asymptotic minimum distance growth rates for 
GTB-LDPC code ensembles and showed that the growth 
rates of GTB-LDPC and GSC-LDPC code ensembles can be 
used to obtain lower and upper bounds, respectively, on the 
free distance growth rate of the associated periodically time- 
varying GLDPCC code ensemble. 
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